Maximum likelihood estimation of a multi- dimensional log-concave density
نویسندگان
چکیده
Let X1, . . . ,Xn be independent and identically distributed random vectors with a (Lebesgue) density f. We first prove that, with probability 1, there is a unique log-concave maximum likelihood estimator f̂n of f. The use of this estimator is attractive because, unlike kernel density estimation, the method is fully automatic, with no smoothing parameters to choose. Although the existence proof is non-constructive, we can reformulate the issue of computing f̂n in terms of a non-differentiable convex optimization problem, and thus combine techniques of computational geometry with Shor’s r -algorithm to produce a sequence that converges to f̂n. An R version of the algorithm is available in the package LogConcDEAD—log-concave density estimation in arbitrary dimensions. We demonstrate that the estimator has attractive theoretical properties both when the true density is log-concave and when this model is misspecified.For the moderate or large sample sizes in our simulations, f̂n is shown to have smaller mean integrated squared error compared with kernel-based methods, even when we allow the use of a theoretical, optimal fixed bandwidth for the kernel estimator that would not be available in practice. We also present a real data clustering example, which shows that our methodology can be used in conjunction with the expectation–maximization algorithm to fit finite mixtures of log-concave densities.
منابع مشابه
LogConcDEAD: An R Package for Maximum Likelihood Estimation of a Multivariate Log-Concave Density
In this document we introduce the R package LogConcDEAD (Log-concave density estimation in arbitrary dimensions). Its main function is to compute the nonparametric maximum likelihood estimator of a log-concave density. Functions for plotting, sampling from the density estimate and evaluating the density estimate are provided. All of the functions available in the package are illustrated using s...
متن کاملlogcondens: Computations Related to Univariate Log-Concave Density Estimation
Maximum likelihood estimation of a log-concave density has attracted considerable attention over the last few years. Several algorithms have been proposed to estimate such a density. Two of those algorithms, an iterative convex minorant and an active set algorithm, are implemented in the R package logcondens. While these algorithms are discussed elsewhere, we describe in this paper the use of t...
متن کاملMaximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency
We study nonparametric maximum likelihood estimation of a log–concave probability density and its distribution and hazard function. Some general properties of these estimators are derived from two characterizations. It is shown that the rate of convergence with respect to supremum norm on a compact interval for the density and hazard rate estimator is at least (log(n)/n) and typically (log(n)/n...
متن کاملSmoothed log-concave maximum likelihood estimation with applications
We study the smoothed log-concave maximum likelihood estimator of a probability distribution on Rd. This is a fully automatic nonparametric density estimator, obtained as a canonical smoothing of the log-concave maximum likelihood estimator. We demonstrate its attractive features both through an analysis of its theoretical properties and a simulation study. Moreover, we use our methodology to d...
متن کاملAPPROXIMATION AND ESTIMATION OF s-CONCAVE DENSITIES VIA RÉNYI DIVERGENCES.
In this paper, we study the approximation and estimation of s-concave densities via Rényi divergence. We first show that the approximation of a probability measure Q by an s-concave density exists and is unique via the procedure of minimizing a divergence functional proposed by [Ann. Statist.38 (2010) 2998-3027] if and only if Q admits full-dimensional support and a first moment. We also show c...
متن کامل